Papers with derivation quality
Exploring the Limits of Fine-grained LLM-based Physics Inference via Premise Removal Interventions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Language models (LMs) perform complex mathematical reasoning in Physics where physical context requires that any symbolic manipulation satisfies complex semantics. |
| Approach: | They systematically remove crucial context from prompts to force instances where model inference may be algebraically coherent, yet unphysical. |
| Outcome: | The proposed models perform poorly in this domain, and their reasoning is not physics-informed. |